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© Method for compressing, processing, and storing grayscale bitmaps. 

@ A method for image processing includes the 
steps of scanning an image (20) within a first 
grid of pixels (22), determining a grayscale 
value for each pixel scanned in the first grid of 
pixels, and, for each pixel scanned, activating a 
number of pixels of a second grid of pixels (25) 
corresponding to the grayscale value deter- 
mined. Data representing the second grid of 
pixels can be compressed, and stored for use in 
facsimile transmission or photoreprographic 
image production. 
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This invention relates to improvements in image 
processing techniques, and more particularly to an 
efficient, rapid, lossless method of compressing, 
processing and storing grayscale bitmaps using algo- 
rithms that are designed for binary images. 5 

In the field of image processing, particularly in re- 
prographic reproduction of an image or in the facsi- 
mile transmission of an image, the need for providing 
grayscale resolution of the image data is becoming of 
increased importance. Also, recently, with improve- 10 
ments in microprocessors and microcontrollers, and 
in digital information handling technologies, image 
data has been read and stored in digital form for proc- 
essing. 

Thus, typically, digital reprographic and image is 
storage systems use a scanner to convert an input 
document to digital form. Such scanners, in their sim- 
plest form, compare the input image on a pixel-by-pix- 
el basis to a predetermined threshold, such that pix- 
els with brightness below the threshold are mapped 20 
to H r (black) and pixels with brightness above the 
threshold are mapped to "0" (white). In more sophis- 
ticated systems, the scanners are capable of discern- 
ing various levels of gray in the image, and have a 
grayscale output, typically 4, 6, or 8 bits per pixel. 25 

While the extension of binary scanners to images 
having grayscale values intermediate black and white 
can be realized with only modest technical and cost 
differences, the differences are much more substan- 
tial between binary output devices, such as displays 30 
and hard copy producing apparatuses, and those ca- 
pable of reproducing gray-levels. This is especially 
true in such hard copy output devices as laser, iono- 
graphic, or inkjet printers. Until recently, most such 
devices were capable of rendering only binary bit- 35 
maps. For this reason, continuous- tone images, such 
as a photograph would be rendered as binary bitmaps 
for printing using halftoning techniques. For example, 
if the original were scanned at 300 spi (12 spots per 
mm) x 4 bit ( 1 6 level) gray, the image could be divided 40 
into 4 pixel x 4 pixel cells, the gray values of the pixels 
within the cell averaged, and then the 16 pixels in the 
cell turned on in proportion to the average gray value 
over the cell; for instance, a gray-level 8 out of 16 
would be represented by blacking 8 of the 16 pixels 45 
in the cell. 

While grayscale hard copy output devices are rel- 
atively rare, it has long been known in the bitmap dis- 
play art that the legibility and apparent image quality 
of an arbitrarily-shaped image (such as typed charac- so 
ters, line-art, etc.) is improved by the technique of 
anti-aliasing. Anti-aliasing provides a method of pre- 
senting bi-level images on finite-resolution bit-map- 
ped printers or displays with improved image quality 
by using intermediate gray-levels for pixels at the 55 
edges of features. More particularly, by this techni- 
que, an image can be rendered to a grayscale display 
of 50 spi (2 spots per mm) x 5 levels of gray by calcu- 



lating what the text or image would look like at 200 spi 
(8 spots per mm), grouping pixels into 2x2 cells, 
counting up the number of pixels which are on, and 
mapping this to the gray-value of the 50 spi (2 spots 
per mm) image. When the image to be rendered is not 
in vector form (such as typed characters or line-art) 
but rather is already in high-resolution binary bitmap 
form, this high-resolution binary to low- resolution 
grayscale rendering is called inverse halftoning. 

Now, recently, hardcopy output devices have be- 
gun to appear that are capable of reproducing a few 
levels of gray, rather than just black or white. One ex- 
ample is a copier/fax that has an 8 bit (256 level) scan- 
ner and can reproduce 6 levels of gray in its printout. 
Even if the original image scanned has no regions of 
intermediate gray, only black marks on white paper, 
for example, the apparent image reproduction quality 
is still improved by grayscale printing because the 
"jaggies" introduced by the finite spatial resolution of 
the scanner are softened using gray on partially oc- 
cluded pixels. If the region does have regions of inter- 
mediate gray (such as a photograph or the like), these 
regions are usually better reproduced by halftone 
techniques than just mapping each pixel into the lim- 
ited number of printable gray values. Thus, such dig- 
ital reprographic systems might be thought of as print- 
ing anti-aliased images, whether the input image is 
monochrome or continuous-tone. 

A key problem faced by systems such as the dig- 
ital copier/fax mentioned above is how to efficiently 
store the scanned images of pages to support fax or 
electronic collation functionality. While compression 
techniques such as CCITT Groups 3 or 4 [G3 or G4] 
are both lossless and efficient for compressing binary 
images (i.e., the bitmap produced from a thresholded 
or half-toned scanned image), they are much less ef- 
ficient at compressing grayscale data. In typical com- 
pression techniques, such as in CCITT G4, the most 
significant bit of the binary word represents the gray- 
level of each image pixel. However, such techniques 
do not efficiently compress the less significant bits 
that are important in grayscale applications. For 
these, special techniques exist (e.g., JPEG) which 
tend to be complex, slow, and sometimes lossy. Cus- 
tom hardware accelerator ASICs for G4 are far more 
wide-spread and far less expensive than JPEG. 

For example, considering a 2-bit gray printing 
process, when a multipage document is being copied, 
it is desirable for the compressed bitmap to be stored 
in system RAM. If gray-level 3 "11 H is black and gray- 
level 0 "00" is white, then the most-significant-bit will 
look like the old binary image, and will compress well 
However, the least-significant-bit will look like the 
regular image with a white line drawn around charac- 
ter outlines. This LSB bitmap will not compress as 
well. Thus, storing the 400 x 2 G3/G4 image takes 
more than twice the space of the 400 x 1 (MSB) bit im- 
age. 
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The compressed version of the second most sig- 
nificant bitplane is 2 to 3 times as large as the most 
significant bit plane because the transition from white 
to black in the original image, once sampled by the 
scanner, involves the transition from gray-level 0 (bi- 
nary OOxxx) to gray-level 1 (binary 01xxx). then 2 (bi- 
nary 10xxx). then gray-level 3 (binary 11xxx). Thus 
the most-significant bit is 0, then 0, then 1, then 1. 
while the 2nd-most significant bit is 0. then 1, then 0, 
then 1 as the scanner sweeps across the white to 
black edge. The G4 technique uses 1 Huffman code 
per transition from pixel-on to pixel-off or vice versa, 
and the 2nd-most-significant bit map has 3 times as 
many transitions as the edge is swept across. 

Other grayscale compression approaches exist. 
For example, one approach is the so-called "Gray 
codes" (see, for example, Logic Design with Integrat- 
ed Circuits, William E. Wickes, (John Wiley & Sons. 
New York, 1968) p 14). Another approach is descri- 
bed in the JPEG/MPEG standards. Gray codes have 
the advantage of being lossless, but would not enable 
standard G4 compressor/decompresor algorithms- 
/chips to be used without special adaptations; 
JPEG/MPEG are, in general, lossy and often intro- 
duce unwanted artifacts in images of fine text. 

Techniques for up-conversion of low-resolution 
gray to high-resolution binary are also known, and 
used in products of the Xerox Corporation, like the 
Docutech or the 7650 scanner, in which the scanner 
actually scans at 400 spi gray and interpolates to 600 
spi binary. 

Reference is also made to K.Y. Wong and B. 
Schatz, in Graphical and Binary Image Processing 
and Applications. J. C. Stoffel, ed., (Artech House, 
Dedham MA, 1982); and US-A-4, 124,870. 

In light of the above, it is an object of the invention 
to provide an efficient, rapid, lossless method for 
compressing, processing, and storing grayscale bit- 
maps using algorithms that are designed for binary 
images. 

In accordance with a broad aspect of the inven- 
tion, a method for image processing is presented that 
includes the steps of scanning an image within a first 
grid of pixels, determining a grayscale value for each 
pixel scanned in the first grid of pixels, and, for each 
pixel scanned, activating a number of pixels of a sec- 
ond grid of pixels corresponding to the grayscale val- 
ue determined. 

Data representing the second grid of pixels can 
be compressed, and stored for use in facsimile trans- 
mission or reprographic image production. 

In accordance with another broad aspect of the 
invention, a method is presented for image process- 
ing. The method includes scanning an image to pro- 
duce a digital representation of the image at a first re- 
solution and with a predetermined number of gray- 
scale values. The digital representation of the image 
is converted to a digital representation of an image 



having an increased resolution at least as great as the 
first resolution times the base-2 logarithm of a prede- 
termined number of grayscale values, and having 
only 2 grayscale values. The converted digital repre- 
5 sentation is then compressed and stored. The stored 
data can be used in facsimile transmission or repro- 
graphic image production. 

The invention thus provides an improved techni- 
que for enabling the efficient compression of the less 
10 significant bits in grayscale bitmap applications. 

The invention also provides an improved method 
for compressing successive bit-planes when operat- 
ing on anti-aliased images, particularly in facsimile 
and reprographic applications. 
is The invention also provides a lossless means for 

storing grayscale bit maps using compression algo- 
rithms which are typically used for binary images, 
such as G3 or G4. 

The invention also provides a method for trans- 
20 mitting data or storing data that requires essentially 
half the transmission time or memory space than pri- 
or data storing and transmitting techniques. 

The invention is illustrated in the accompanying 
drawing, in which: 
25 Figure 1 is a diagram of four grayscale values and 

their binary representations in forming grayscale im- 
ages thereof. 

Figure 2 is an image having the four grayscale 
values of Figure 1 that is desired to be stored and 
30 processed. 

Figure 3A is a binary image produced using the 
least significant bit values of the grayscale values of 
the image of Figure 2, using prior art techniques. 
Figure 3B is a binary image produced using the 
35 most significant bit values of the grayscale values of 
the image of Figure 2, using prior art techniques. 

Figure 4A is a grayscale image having a resolu- 
tion of 400 spi X 2 bits (4 grayscale levels), that is de- 
sired to be stored and processed. 
40 Figure 4B is a binary image formed of the image 

of Figure 4A, having a resolution of 800 spi X 1 bit (2 
grayscale levels), produced in accordance with the 
method of the invention. 

And Figure 5 is a block diagram illustrating the 
45 steps of processing a grayscale image in accordance 
with the invention. 

As will become apparent, the invention is partic- 
ularly useful in processing an image that has multiple 
grayscale values. An arbitrary image having the four 
50 grayscale values shown in Figure 1 is depicted in Fig- 
ure 2. The image of Figure 2 is depicted as it might be 
processed by a scanner or other device known in the 
art and is partitioned into pixels 12, each of which 
having a particular grayscale value. 
55 The four grayscale values shown in Figure 1 are 

numbered 0-3. representing increasing levels of black 
from white. Thus, the first level 0 is white, and, when 
mapped to a two-bit binary value, has a grayscale val- 
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ue of "00". The black level maps to the two-bit binary 
value "11", and the two intermediate gray-levels map 
to binary values "01 " and "1 0". Of course, any number 
of grayscale values can be defined, four being descri- 
bed as being merely exemplary. 5 

As mentioned above, in the past, one technique 
that has been employed in the processing of an im- 
age such as that of Figure 2 has been to generate a 
plurality of bit planes, each comprising the values at 
respective bit levels of grayscale information. Thus, in w 
accordance with the prior art. as shown in Figures 3A 
and 3B, the image of Figure 2 would be mapped into 
the respective least significant bit plane shown in Fig- 
ure 3A and most significant bit plane shown in Figure 
3B. It is noted that the least significant bit map of Fig- is 
ure 3A has a "ghost halo" surrounding the image, and 
that the black values and an intermediate gray value 
map to the same black level. The combination of the 
bit maps of Figures 3A and 3B do not compress effi- 
ciently, using standard image compression techni- 20 
ques such as CCITT techniques G3 and G4. 

On the other hand, the present invention pro- 
vides a novel, substantially lossless method for stor- 
ing grayscale bitmaps using compression algorithms 
that are normally used for binary images, such as G4. 25 
In the case of G4, it is twice as efficient as the tech- 
nique of compressing successive bit-planes (i.e.. the 
binary bitmaps of the most-significant bit next-most- 
significant bit, etc.) when operating on anti-aliased 
images. This halving of memory requirements 30 
equates to halving the telephone charges for facsi- 
mile transmissions or halving the required RAM or 
disk space for digital copiers or image storage sys- 
tems. 

With reference now to Figures 4A and 4B, an inv 35 
age 20 to be processed is shown in Figure 4A. Again, 
the image is an arbitrary image, and, in the embodi- 
ment illustrated, has four grayscale levels as defined 
in Figure 1 , but any number of grayscale values could 
be employed. The pixels 22 of the image 20 have a 40 
resolution of, for example, 400 spi (16 spots per mm). 
Thus, the resolution of the image 20 of Figure 4A is 
referred to herein as 400 spi x 2, representing, there- 
fore, a resolution of 400 spi (16 spots per mm) having 
four grayscale levels. 45 

In accordance with the invention, as explained in 
conjunction with the flow chart of Figure 5, the image 
20 is scanned 50. The grayscale value of each pixel 
is determined 52. Then, the image 20 is mapped onto 
a binary grid of increased resolution 53, to produce an so 
image 20' as that shown in Figure 4B. The image 
20' is of increased resolution; in the embodiment 
shown it is twice that of the image 20 of Figure 4A. 
Thus, for each pixel 22 of the image 20 of Figure 4A, 
four pixel portions 25 of the image 20' exist. 55 

As each of the pixels 22 of the image 20 of Figure 
4A is mapped to the grid of higher resolution to form 
the image 20' of Figure 4B. the binary values of each 



of the pixels 22 of the image 20 are used to determine 
the number of pixels in the image 20* that are black- 
ened. Thus, for example, a black image having a two 
bit binary value of 11 is represented by all four pixel 
portions of the image of increased resolution 20* be- 
ing blackened. A gray-level having a two bit binary 
grayscale value of "1 0" maps to three of the four pixel 
portions of the image of increased resolution being 
blackened. A grayscale level having a two bit binary 
grayscale value of "01 " is mapped to blacken only one 
of the four pixel portions of the image 20' of increased 
resolution. A grayscale value of white, represented by 
the two bit binary number "00" maps to no pixel por- 
tions of the grid of Figure 4B being blackened. It will 
be appreciated that although a two bit binary value 
representing four grayscale values has been illustrat- 
ed in Figures 4Aand 4B, any number of grayscale val- 
ues can be mapped to a higher resolution grid. In such 
case, the mapping requires that each pixel of the orig- 
inal image map to a number of pixel portions that cor- 
respond to or are larger than the number of grayscale 
levels in the original image. 

Thus, the image 20' of increased resolution as a 
binary image that can easily be compressed 54 using 
standard CCITT techniques such as G3 or G4, or 
other compression technique. The compressed im- 
age can then be stored 55 for subsequent use, such 
as to produce reprographic copies or facsimile trans- 
mission, or the like, or immediately transmitted 56 for 
decompression 58 and processing 59. In the stored 
image case, the stored image merely needs to be re- 
trieved 57 and decompressed 58 and processed 59. 
as desired. 

When the image is to be decompressed, for ex- 
ample, an 800 spi (32 spots per mm) image can be de- 
compressed 2 lines at a time, grouped into 2x2 cells. 
The printer gray-level is then established by mapping 
the counted density in the cell (5 possible levels for 
a 2 x 2 cell) into the printable levels (4 in the embodi- 
ment illustrated). 

More particularly, in a system having a 400 spi 
(16 spots per mm) scanner whose output is used to 
compose a 400 spi (16 spots per mm) x 2 bit anti- 
aliased image for processing, the image can be stor- 
ed most efficiently in memory for reproduction, facsi- 
mile, or network transmission by first up-converting 
it to 800 spi x 1 and then compressing it, using, for ex- 
ample a G4 technique. If the image is to be printed, 
for example, as a part of a reprographic process, the 
higher resolution image can be retrieved from mem- 
ory, decompressed and inverse halftoned down to 
the print resolution of the particular machine em- 
ployed. Or, for example, if the image is to be transmit- 
ted via facsimile, the compressed image can be re- 
trieved from memory, transmitted, then decom- 
pressed for display 61 or hard copy generation 60. 

The method of the invention, furthermore, can be 
used to enhance the image reproduction capabilities 
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of reprographic machines that have different resolu- 
tion scanning and copy or printing reproduction capa- 
bilities. For example, if a particular hard copy device 
has a scanning and reproduction resolution of 400 X 
3, a digital representation of the image can be con- s 
verted to a higher resolution, for instance of 1200 X 
1 . If another copier, or printer, has, for instance, a dif- 
ferent resolution, such as 600 x 1, then interchange 
from the lower (400, gray) to higher (600. binary) re- 
solution machine can be made by decompressing the w 
intermediate (1200) very-high-resolution image with 
every other pixel and every other line used to com- 
pose the 600 x 1 image for the higher resolution ma- 
chine, thereby introducing minimal image distortion. 

It will be appreciated that the method of the in- 15 
vention is not limited to reprographic or facsimile sys- 
tems. It is useful wherever images are intended to be 
rendered on a grayscale output device, such as a 
grayscale display of an image-retrieval system, or the 
like. 20 

It will be also appreciated that the technique of 
the invention is most efficient for anti-aliased images, 
that is. images where gray valued pixels are only 
found in the sweep between black and white. This 
technique would not be as efficient if the region were, 25 
say, uniformly at gray-level 2 (binary "0V) out of 4 
grayscale levels. 



Claims 



3. The method of claim 2 wherein the resolution of 
said first grid of pixels is about 400 spi (16 spots 
per mm), and the number of grayscale values is 
4, and wherein the resolution of said second grid 
of pixels is about 800 spi (32 spots per mm), and 
the number of grayscale values is 2. 

4. The method of any one of claims 1 to 3 further 
comprising compressing the second grid of pixels 
to form a compressed converted binary image 



30 



1. A method for image processing, comprising: 

scanning an image (20) within a first grid 
of pixels (22); 

determining a grayscale value for each 35 
pixel scanned in said first grid of pixels; and 

for each pixel scanned, activating a num- 
ber of pixels of a second grid of pixels (25) corre- 
sponding to the grayscale value determined. 

40 

2. The method of claim 1 wherein said first grid of 
pixels represents an image of first resolution, and 
said second grid of pixels represents an image of 
second resolution at least as large as the resolu- 
tion represented by the first grid of pixels times 45 
the base-2 logarithm of the number of grayscale 
values that can be detected in said first grid. 



so 
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representation, and storing the compressed con- 
verted binary representation in a memory. 

5. A method for image processing, comprising: 

scanning an image to produce a binary 
representation of said image at a first resolution 
and with a predetermined number of grayscale 
values; 

converting the binary representation of 
said image to a binary representation of an image 
having an increased resolution at least as great 
as the first resolution times the base-2 logarithm 
of the predetermined number of grayscale val- 
ues, and having only 2 grayscale values; 

compressing the converted binary repre- 
sentation; 

and storing the compressed converted bi- 
nary representation. 



6. 



The method of claim 5 further comprising trans- 
mitting the compressed converted binary repre- 
sentation as a part of a facsimile data transmis- 
sion. 



7. The method of claim 6 further comprising receiv- 
ing the transmitted compressed converted binary 
representation, decompressing the received 
compressed converted binary representation, 
and reproducing an image from the decom- 
pressed binary representation. 

8. The method of claim 5 further comprising decom- 
pressing the compressed converted binary rep- 
resentation, and reprographically reproducing an 
image from the decompressed binary represen- 
tation. 

9. The method of claim 8 further comprising per- 
forming an inverse half-tone process on the de- 
compressed binary representation. 

10. A method for compressing binary image data 
having a plurality of grayscale values, compris- 
ing: 

converting the image data to a binary rep- 
resentation of an image having an increased re- 
solution at least as great as the first resolution 
times the predetermined number of grayscale 
values and having only 2 grayscale values; 

and determining the grayscale values of 
the converted binary representation from the 
most significant bits of the image data. 
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Scanning an 
image 



Determining the 
grayscale value of each 
pixel 



Mapping the image to a 
binary grid of increased 
pixel resolution 



Compress the increased 
resolution image 



Transmit 
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Store 




Retrieve 



Decompress the increased 
resolution image 
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Map the increased resolution 
image back to, for example, the 
original resolution, gray-scale 
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Method for compressing, processing, and storing grayscale bitmaps 



(57) A method for image processing includes the 
steps of scanning an image (20) within a first grid of pix- 
els (22). determining a grayscale value for each pixel 
scanned in the first grid of pixels, and. for each pixel 
scanned, activating a number of pixels of a second grid 
of pixels (25) corresponding to the grayscale value de- 
termined. Data representing the second grid of pixels 
can be compressed, and stored for use in facsimile trans- 
mission or photoreprographic image production. 
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